Web Survey Bibliography
New data collection technologies make it possible to combine many benefits of interviewer and self-administration. For example, a webbased questionnaire can offer clarification to a respondent who gives evidence of confusion. A natural extension of this process is the introduction of virtual or animated interviewing agents into computerized questionnaires: graphical, moving entities in the user interface that ask questions, record answers and potentially do much more. The proposed talk reports a laboratory experiment in which animated interviewing agents asked (spoke) questions about ordinary non-sensitive behaviors and 73 respondents answered (by speaking) based on fictional scenarios (Schober & Conrad, 1997). Our main question is whether response accuracy is affected by how realistic the agent looks (amount of facial and head movement) and how capably it can converse with a respondent (ability to clarify questions when it seems this might help). The interviewing agent assigned to any one respondent was either high or low in ‘visual realism’ and high or low in ‘dialogue capability.’ Half of the scenarios were designed to be ambiguous without clarification. Looking just at these cases, respondents were approximately 30% more accurate when the agent was high in dialogue capability than when it was low. However there was no impact of visual realism. Respondents looked at the agent 20-30% of the time – long enough to perceive its visual attributes and, in fact, respondents’ ratings of the agent were affected by its visual realism as was the way they interacted with the agent. Yet high visual realism did not increase respondents’ requests for clarification – one action that could have improved response accuracy. Interviewing agents asking non-sensitive questions will produce better data if they can converse intelligently; however, more realistic-looking agents might help in ways not studied here, e.g. motivating potential respondents to participate and complete questionnaires.
Homepage (abstract)
Web survey bibliography - Conrad, F. G. (38)
- Comparing acquiescent and extreme response styles in face-to-face and web surveys; 2017; Liu, M.; Conrad, F. G.; Lee, S.
- Respondent mode choice in a smartphone survey ; 2017; Conrad, F. G., Schober, M. F., Antoun, C., Yan, H. Y., Hupp, A., Johnston, M., Ehlen, P., Vickers, L...
- Effects of Mobile versus PC Web on Survey Response Quality: a Crossover Experiment in a Probability...; 2017; Antoun, C.; Couper, M. P.; G. G.Conrad, F. G.
- Comparisons of Online Recruitment Strategies for Convenience Samples: Craigslist, Google AdWords, Facebook...; 2016; Antoun, C., Zhang, C., Conrad, F. G., Schober, M. F.
- The Effect of Respondent Commitment and Tailored Fe edback on Response Quality in an Online Survey ; 2016; Cibelli Hibben, K.; Conrad, F. G.
- Comprehension and engagement in survey interviews with virtual agents; 2016; Conrad, F. G.; Schober, M. F.; Jans, M.; Orlowski, R. A.; Nielsen, D.; Levenstein, R. M.
- Social Media Analyses for Social Measurement; 2016; Schober, M. F.; Pasek, J.; Guggenheim, L.; Lampe, C.; Conrad, F. G.
- An experiment testing six formats of 101-point rating scales; 2015; Liu, M.; Conrad, F. G.
- Matrix versus paging designs in a brand attribution task; 2014; Conrad, F. G., McCullough, W., Nishimura, R.
- Speeding in Web Surveys: The tendency to answer very fast and its association with straightlining; 2013; Conrad, F. G.; Zhang, Che.
- Disfluencies and Gaze Aversion in Unreliable Responses to Survey Questions; 2012; Schober, M. F., Conrad, F. G., Dijkstra, W., Ongena, Y. P.
- Database Lookup in Web Surveys; 2012; Couper, M. P., Zhang, C., Conrad, F. G., Tourangeau, R.
- Interactive interventions in web surveys can increase response accuracy.; 2011; Conrad, F. G.
- Race-of-Virtual-Interviewer Effects; 2011; Conrad, F. G., Schober, M. F., Nielsen, D.
- Which Web Survey Respondents Are Most Likely to Click for Clarification?; 2011; Coiner, T., Schober, M. F., Conrad, F. G.
- Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of...; 2011; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Professional Web Respondents and Data Quality; 2010; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Increasing Respondents' Use of Definitions in Web Surveys; 2010; Peytchev, A., Conrad, F. G., Couper, M. P., Tourangeau, R.
- Interactive Interventions in Web Surveys Can Increase Respondent Conscientiousness; 2009; Conrad, F. G., Tourangeau, R., Couper, M. P., Kennedy, C.
- Envisioning the Survey Interview of the Future ; 2009; Conrad, F. G., Schober, M. F.
- Experimenting With Speech Interactive Voice Response, Touchtone Data Entry and the Web for the National...; 2009; Cantor, D., Brick, P. D., Tourangeau, R., Conrad, F. G.
- Interactive feedback can improve accuracy of responses in web surveys; 2009; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Response Order and Response Distributions: The Format of the Response Options in a Web Survey; 2009; Tourangeau, R., Conrad, F. G., Couper, M. P., Balter, O.
- Improving the Design of Complex Matrix Questions; 2009; Couper, M. P., Tourangeau, R., Conrad, F. G.
- Classifying Open Occupation Descriptions in the Current Population Survey; 2008; Conrad, F. G., Couper, M. P.
- Social Cues Can Affect Answers to Threatening Questions in Virtual Interviews; 2008; Lind, L. H., Schober, M. F., Conrad, F. G.
- Virtual Interviews on Mundane, Non-Sensitive Topics: Dialog Capability Affects Response Accuracy More...; 2008; Conrad, F. G., Schober, M. F., Jans, M., Orlowski, R. A., Nielsen, D.
- The Impact of the Spacing of the Scale Options in a Web Survey; 2008; Kennedy, C., Tourangeau, R., Conrad, F. G., Couper, M. P., Redline, C. D.
- Surveys interviews and new communication technologies; 2007; Schober, M. F., Conrad, F. G.
- Interactive Features of Web Surveys; 2007; Conrad, F. G.
- The Impact of the Visible: The Design of Web Surveys; 2007; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Color, Labels, and Interpretive Heuristics for Response Scales; 2006; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Visual Context Effects in Web Surveys; 2005; Couper, M. P., Conrad, F. G., Tourangeau, R.
- Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions; 2004; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Web Survey Design: Paging vs. Scrolling; 2004; Peytchev, A., Crawford, S. D., McCabe, S. E., Conrad, F. G., Couper, M. P.
- Use and non-use of clarification features in web surveys; 2003; Tourangeau, R., P., Couper, M. P., Conrad, F. G., Baker, R. P.
- What They See Is What We Get: Response Options for Web Surveys; 2003; Couper, M. P., Tourangeau, R., Conrad, F. G., Crawford, S. D.